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1 .  INTRODUCTION 


The  study  of  optimal  filtering  has  evolved  around  the  well-known 
techniques  of  Kalman  filtering  [1]  and  Wiener  filtering  [2].  Though  each 
provides  a  convenient  method  of  designing  optimal  filters,  both  have 
inherent  limitations  on  the  nature  of  the  system  to  which  they  may  be  applied 
In  particular,  Kalman  filtering  requires  the  noise  to  be  white  or  repre¬ 
sentable  as  the  output  of  a  finite-dimensional  linear  system  driven  by  white 
noise.  The  Wiener  approach  allows  for  wide  sense  stationary  second-order 
noise  processes  with  second-order  properties  that  are  known  exactly.  For 
many  practical  situations  precise  knowledge  of  these  second-order  properties 
is  unrealistic.  Vastola  [3]  has  shown  that  the  performance  degradation  of 
Wiener  filters  under  small  deviations  from  assumed  nominal  noise  spectra 
can  render  such  a  design  virtually  useless  upon  implementation. 

Consequently,  a  preferable  design  procedure  might  guarantee  a 
minimvon  performance  level  over  a  range  of  power  spectral  density  functions 
in  the  noise  process.  Several  authors  have  approached  this  robust  Wiener 
filtering  problem  using  the  game-theoretic  minimax  formulation  and  a  mean- 
square  error  cost  function,  under  various  assumptions  on  the  filter 
structure  and  models  by  which  the  classes  of  power  spectral  densities 
(PSD's)  are  specified.  Kassam  and  Llm  [4]  have  solved  the  non-causal  robust 
filtering  problem  for  two  useful  spectral  uncertainty  classes ,  known  as  the 
spectral-band  and  mixture  (or  e-band)  uncertainty  models.  Poor  [5]  has 
solved  the  "total-variation"  non-causal  problem,  and  in  the  same  paper 
addressed  some  aspects  of  the  causal  problem.  Poor  and  Loose  [6]  have  also 
discussed  in  some  detail  the  solution  of  causal  problems  for  systems  which 
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may  be  represented  by  single-dimensional  linear,  time-invariant  state-space 
equations  with  either  process  or  observation  noise  known  to  be  white  and 
the  other  process  specified  by  a  spectral  uncertainty  class .  The  common 
feature  of  all  of  these  studies  is  that  they  are  limited  to  problems  in  which 
a  single  state  process  must  be  estimated  from  a  single  observation  process. 
Therefore  these  robust  filtering  results  are  applicable  only  to  inherently 
"single-dimensional"  estimation  problems. 

The  usefulness  of  the  robust  filtering  ideas  could  be  enhanced 
considerably  if  they  were  extended  to  estimation  of  vector  state  processes 
from  vector  observation  processes.  The  author  is  unaware  of  any  robust 
filter  results  for  this  most  general  multivariable  problem,  aside  from  the 
special  case  of  vector  white  process  and  observation  noises  with  uncertain 
componentwise  correlation  treated  by  Poor  and  Looze  [6].  ^ 

This  thesis  represents  a  first  Investigation  of  how  robust 
filtering  problems  may  be  formulated  and  solved  in  the  multivariable 
setting.  Attention  is  focused  on  problems  of  estimating  a  state  vector  for 
dynamical  systems  driven  by  a  scalar  process  noise,  using  a  scalar  observa¬ 
tion  process  corrupted  by  a  scalar  observation  noise.  For  these  multiple- 
state  problems,  two  suitable  robust  filter  problem  formulations  are  posed, 
the  state-by-state  and  least-sqxiares  robust  problems.  Solution  of  the  state- 
by-state  problem  follows  easily  from  one-dimensional  techniques;  the  same  is 
not  true  of  the  least-squares  formulation. 

However,  when  attention  is  restricted  to  non-causal  problems 
with  spectral-band  noise  uncertainties,  the  state-by-state  and  least- 
squares  approaches  are  shown  to  yield  the  same  solution.  This  equivalence 
is  established  first  as  a  theorem  supported  by  the  state-by-state  solution 
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procedure  and  properties  of  the  minimax  formulations ,  and  secondly  by 
direct  calculation  of  the  least-squares  solution  through  an  appropriate 
transformation.  Consequently,  design  of  robust  filters  for  state 
estimation  (either  state-by-state  or  lease-squares  robust)  may  be  performed 
using  the  more  expedient  state-by-state  methodology.  Accordingly,  a  design 
procedure  is  outlined  for  non-causal,  spectral  band,  multiple-state  robust 
estimators . 

Many  practical  state  estimation  problems  require  a  causal  estimator 
structure.  Unfortunately,  the  non-causal  techniques  are  not  generally 

s. 

applicable  to  causal  problems.  Some  aspects  of  the  causal  estimation  problem 
are  discussed,  since  they  illustrate  the  true  multivariable  character  of 
the  general  state-by-state  and  least-squares  approaches  and  reinforce  the 
significance  of  the  non-causal  findings. 

Section  2  is  intended  to  provide  a  brief  review  of  the  optimal 
filtering  problem  and  summarize  relevant  robust  one-dimensional  Wiener 

filtering  results.  Section  3  covers  multiple-state  robust  estimation. 

/ 

Section  4  illustrates  the  significant  results  of  Section  3  with  a  design 
example.  Finally^,  Section  5  summarizes  the  findings  of  this  paper  and 
poses  several  issues  for  further  study. 


2 .  OPTIMAL  ESTIMATION 


This  chapter  provides  the  requisite  background  information  for  the 
subsequent  discussion  of  multiple-state  estimation.  The  first  section 
outlines  the  well-known  results  of  optimal  filtering  for  continuous -time 
systems.  Stationary,  linear,  time- invariant  Wiener  filtering  is  developed 
and  the  connection  to  the  popular  methods  of  Kalman  drawn.  The  remainder  of 
this  chapter  is  devoted  to  discussing  robust  state  estimation  results  for 
one-dimensional  systems.  The  minlmax  problem  is  posed,  the  relationship  to 
the  associated  maximin  problem  discussed,  and  suitable  spectral  uncertainty 
classes  presented.  The  specific  example  of  spectral-band  uncertainty  for 
non-causal  filtering  is  elaborated  on  for  use  in  subsequent  chapters . 


2.1.  Solutions  to  the  Wiener-Hopf  Equation 

This  thesis  is  concerned  with  estimating  a  continuous- time  state 
process  denoted  x^  (or  equivalently  x(t))  from  a  continuous-time  observed 
process,  y^  (yCx)).  Each  process  may,  in  general,  be  an  infinite- 
dimensional  vector  process.  The  estimation  problem  is  then  to  obtain  x^, 
an  estimate  of  the  state  process  which  satisfies 

*t  "  (2.1.1) 


The  observation  process  may  be  represented  by  an  equation 


^  t 


(2.1.2) 


with  il(*)  indicating  any  mean-square  integrable  function  of  x^.  It  may  be 

2 

assumed  that  the  processes  i([x^],  n^  and  y^  are  second-order  (i.e.  E{n  }  < « 
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for  all  etc.),  that  the  second-order  properties  of  each  process  are 

known,  and  that  the  optimal  filter  is  defined  as  the  filter  which  minimizes 
the  weighted  mean-square  error  beteeen  and  x^,  then  the  problem  may  be 
formulated  using  the  techniques  of  Wiener  and  Kolmogorov.  The  optimization 
problem  may  then  be  stated 


A  ^  T  A 

X  »  arg  min  E{(x  -x  )  Q(x  -x  )|y  } 
t  t  t  t  t  T 

t  y 

for  all  tej"  ,  rej”  , 
X  y 


(2.1.3) 


and  finite-dimensional  x^  and  y^  ;  where  Q  is  an  n^n  nonnegative  definite 
symmetric  weighting  matrix  (assuming  x^  is  an  nxl  vector) ,  and  denotes 
the  class  of  all  mean-square  integrable  functions  of  y^,  t  and  t. 

Elementary  mean-square  estimation  arguments  (see  for  example,  Papoulis  [7]) 
show  that  the  optimal  mean-square  estimator  is  affine  in  y^  (of  the  form 
x^“JC(y^)+b,  with  jC  a  linear  operator).  Hence,  without  loss  of  generality, 

3Cy  may  be  restricted  to  affine  functions  of  y^.  In  fact  the  orthogonality 
principle  (see  for  example,  Wong  [8])  states  that 
b 

Xt  “  /  h^pj(t,T)y(T)dT  +  b  (2.1.4) 

solves  the  minimization  problem  (2.1.3)  if  and  only  if 

E{Xj.}  -  E{Xj.}  (2.1.5) 

and 

E  (x^-x^)(y  )^  •  0,  (2.1.6) 

The  first  condition  dictaf  s  that  the  mean  function  of  x^  satisfy 
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E{x  }  =  E{x  }  =  /  h  (t,T)E{y  }dT  +  b, 
C  t  op  C  T 

a 

and  the  second  Implies 


where 


R^(t,T)  =  /  h^p^(t,a)R^(a,T)do  +  bE{y^}, 

cl 


R  (t,T)  =  E{x  y^}  and  R  (a.x)  =  E{y  y^}- 
xy  t  T  y  u  T 


h^pj.(t,T)  will  be  termed  the  optimal  impulse  response. 

covariance  matrix  C  (t,T)  may  be  expressed  as 

xy 


Note  that 


C^(t,T)  =  R^(t,T)  -  E{x^}E{y^} 


and  i.-om  (2.1.7)  above 


b  =  E{x^}-/  h^  (t,T)E{y^}dT, 


equation  (2.1.8)  reduces  to 


C  (t,T)  =  /  h  (t,0)C  (a,T)d0. 

y  a  ^  y 


Without  loss  of  generality,  it  may  be  assumed  that 


E{x  >  =•  E{y  }  -  0. 
t  T 


Consequently 


R  (t,T)  =  /  h  (t,0)R  (0,T)d0,  oe  [a,b] 

xy  ^  P  y 


(2.1.7) 


(2.1.8) 


(2.1.9) 

since  the 


(2.1.10) 


(2.1.11) 


(2.1.12) 


(2.1.13) 


(2.1.14) 


This  fundamental  result  is  commonly  referred  to  as  the  Wiener-Hop f  equation 
(for  continuous  time  processes).  When  a  solution  can  be  found,  the  optimal 
estimate  is  given  by 


't  ’  ^  h  (t.T)y(T)dT, 


(2.1.15) 


This  is  the  Wiener-Hopf  formulation  of  the  optimal  filtering  problem  in  a 
quite  general  form.  The  underlying  assumptions  made  to  pose  a  problem  in 
this  form  are : 

i)  The  processes  involved  are  second-order,  with  known  second  order 
properties .  That  is ,  the  mean  and  auto-correlation  of  each  process 
may  be  calculated  from  the  problem  statement.  Additionally,  the 
cross-correlation  between  processes  and  y^  is  also  given 
either  explicitly  or  implicitly. 

ii)  The  optimal  filter  is  the  best  linear  filter  or  (equivalently)  the 
minimum  mean-square  error  filter. 

iii)  The  state,  noise  and  observation  processes  are  all  continuous¬ 
time  vector  quantities  of  finite  dimension. 

Now  it  would  appear  that  the  optimal  filtering  problem  is  solved. 
Indeed  equation  (2.1.14)  may  be  solved  numerically  in  its  most  general  form 
to  yield  an  approximate  solution  useful  for  some  purposes  (i.e.  design 
of  Wiener  filters  for  systems  with  well-known  spectral  properties) . 

However,  for  purposes  of  the  subsequent  discussion  of  robust  filtering,  more 
explicit  expressions  for  h^p^(t,T)  are  highly  desirable.  Such  explicit 
expressions  exist  for  several  special  cases  of  the  more  general  problem 
statement. 

Perhaps  the  most  Immediate  result  occurs  if  all  of  the  random 
processes  are  not  only  second  order,  but  wide-sense  stationary  as  well,  and 
^y“  (”“»  +  ")  “  (a»b).  Such  an  estimator  is  non-causal  since  the  entire 
sample  path  of  y_  is  used  to  estimate  x^  for  each  t,  the  observed 


8 


process  after  is  used  to  compute  k(t^)  .  Since  R^(T,a)  then  equals 
R^(T-a),  then  Wiener-Hopf  equation  becomes 

CO 

R  (t)  -  /  h  fa)R  (T-a)da.  (2.1.16) 

The  time-invariance  and  infinite  bounds  on  the  integral  make  solution 
routine  using  Fourier  transform  techniques,  resulting  in  the  explicit 
solution 

‘  (2.1.17) 

The  optimal  filter  is  then  of  the  form 

x(u))  =■  H  ^(a))Y(u)  (2.1.18) 

opt 

or  in  the  time  domain  again 

CO 

X  =  /  h  (a)y(T-a)d(j,  (2.1.19) 

Of  course  S  (co)  denotes  the  cross  spectral  density  of  x  and  y  (the  Fourier 
xy  t  t 

transfotmi  of  R  (x)),  and  capital  letters  denote  the  Fourier  transforms  of 
xy 

their  corresponding  lower-case  counterparts.  This  result  is  very  significant 
in  that  it  provides  a  very  easily  computed  optimal  filter  when  a  problem  may 
be  posed  in  such  a  form.  Equation  (2.1.17)  will  be  used  extensively  in  the 
following  chapters. 

A  second  special  case  of  the  Wiener-Hopf  equation  arises  if  the 
estimate  of  x(t^)  is  required  at  t^,  and  the  random  processes  are  again 
wlde-sense  stationary.  Then  the  estimate  of  x(t^)  is  based  on  the  sample 
path  y^,  T€  (-®,  tj^)  instead  of  y^,  t6  (-»,+  *)  and  the  filter  is  termed 
causal.  The  derivation  of  the  causal  solution  is  discussed  in  some  detail 


by  any  number  of  sources,  see  for  example  Wong  [8],  or  the  original  work  of 
Wiener  [2] .  The  highlights  of  the  solution  are  presented  here  for  the 
scalar  observation  process  case,  as  they  are  pertinent  to  subsequent  causal 
filter  discussions  in  this  paper. 

If  the  spectral  density  function  of  the  observation  process  y^ 
satisfies  the  Paley-Wiener  condition. 


«  I  log  S  (oj) 


-«  1  +  0) 


Ai\<  * 


(2.1.20) 


then  ®ay  be  factored  into  two  multiplicative  terms  S^Cw)  and  S^(a)) 

which  have  the  following  properties : 


Sy(u))  “  (u))  (co) 


(2.1.21) 


^{S^(u)}  »  0  for  t<0  (causal) 


(2.1.22) 


^{S”(cj)}  =  0  for  t>0  (anti-causal) 


(2.1.23) 


The  above  conditions  also  imply 


’Y— I 

lSy(a))J 


0  for  t  <  0  also. 


(2.1.24) 


The  fundamental  result  of  Wiener  states  that  if  the  Paley-Wiener  condition  is 
satisfied,  as  it  is  in  most  physically  meaningful  situations,  then  the 


optimal  causal  filter's  transfer  function,  H'  ^(ui)  is  given  by  the  expressslon 

Opt 


00  *  *  S  (n) 

dt.  (2.1.25) 

"P*"  S+(u,)  0  j 

y  L  y  J 


Defining 


S_  (o)) 


S  (co) 

y 


(2.1.26) 


it  is  easy  to  see  that 


I  e^“\(t)dt. 

S^U)  0  ^ 

y 


(2.1.27) 


Now  define 


h2(t) 


hj^(t)  if  t  >  0 


0  if  t  <  0 


Then 

(u)  -  H  (a»). 

°P’=  S^(a))  ^ 

which  will  be  referred  to  henceforth  as 


(2.1.28) 


(2.1.29) 


-  [S  (u) 

s^(»)  L  s^M  J  ^ 


(2.1.30) 


A  subscripted  +  (or  -)  sign  denotes  H2(u)  (H2(u))),  which  may  be  found  by 
inverse  Fourier  transforming  H^(ai),  truncating  hj^(t)  by  setting  its  anti- 
causal  (causal)  part  to  zero,  and  transforming  the  result  to  give  H2(oj)  (or 
^2(0)))  as  outlined  above.  This  operation  is  frequently  referred  to  as 
additive  decomposition  of  Hj^(a))  into  causal  and  anti-causal  components,  since 


H^(a))  -  H2(a))  + 


(2.1.31) 


and  H2(u))  is  causal  while  ^2(1*))  is  anti-causal.  Again  an  explicit  expression 
has  been  found  for  the  optimal  filter  in  terms  of  the  spectral  properties  of 
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the  random  processes  involved.  For  this  causal  problem,  however,  the 
spectral  factorizations  involved  in  computing  the  optimal  transfer  function 
are  considerably  more  involved.  This  complexity  is  compounded  when  robust 

I 

causal  filtering  problems  are  discussed  later. 

Recall  that  both  of  the  special  cases  considered  thus  far  are 
expressed  in  frequency  domain  terms .  This  type  of  analysis  also  leads  to  a 

I 

convenient  expression  for  the  mean-square  error  under  the  system  equations  • 

may  be  written  in  state-space  form: 


>'t  ■  ®t- 


(2.1.32) 

(2.1.33) 


5^  and  0^  are  (nxl)  and  (mxl)  wide-sense  stationary,  zero  mean  vector  random 
processes  such  that 


E{Cj.  -  R^(t-T), 


E{9^  eM  -  Rg(t-T), 


£{0^.  Cp  -  0. 


(2.1.34) 

(2.1.35) 

(2.1.36) 


x^  is  an  (nxl)  state  vector,  y^  is  an  (mxl)  observation  vector,  and  A  and  C 
are  suitably  dimensioned  constant  matrices. 

Now  if  X(Ja))  is  defined 


X(juj)  -  H(joj)Y(ju))  -  H(ja))CX(ja))  +  H( ju)  ®  (ju) 


(2.1.37) 


X(ja))  forms  a  (not  necessarily  optimal)  estimate  of  X(ji*)) ,  for  which  the 


mean-square  error 


D 


a  »  E{(x^-x^)  Q(x^-x^)} 


may  be  computed.  Using  the  trace  identity 


(2.1,38) 


tr{AB}  »  tr{BA} 


and  Parsenal's  theorem,  (2.1.38)  becomes 


(2.1.39) 


a  -  trE{  Q  /x(+ja))xVjt^)  -  X(+ju))x’^(-jaj)  -  X(+ja))X^(-ja)) 


+  X(+ja))X^(-jaj)da)}, 


(2.1.40) 


Now  substitute  equation  (2.1.37)  and  note  that  for  second-order  9^  and  5^, 
equation  (2.1.36)  implies 


E{/  ®(ju)H^(-ja))da)}  =*  0. 


(2.1.41) 


Substituting  into  the  error  expression. 


00 

a  =  tr[E{Q  /  [I-HC](jajI-A)*HE(jou)H^(+j'D)B'^(+ju)I-A)"”  [I-HC]®dw 


+  q  /  H0  (joj)(S^(jui)H^du>}] 


(2.1.42) 


After  simplification, 


a  -  tr[Q  /  [I-HC]  (jojI-A)"^BS  B'^(ja)I-A)"“[I-HC]^dtj 


+  Q  /  HS^H^^do)] . 


(2.1.43) 


When  all  of  the  system  parameters  are  known,  the  mean-square  estimation 
error  may  be  calculated  directly  using  this  result. 

The  two  special  cases  presented  thus  far  are  tractable  by  virtue 


of  their  stationarity ,  and  the  consequent  applicability  of  frequency  domain 
analysis.  By  making  different  underlying  assumptions  on  the  system  structure, 
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time  domain,  analysis  may  be  used  to  full  advantage  with  techniques  originated 
by  Kalman  and  Bucy  [1]. 

The  details  of  Kalman  filtering  are  largely  irrelevant  to  the 
current  discussion,  yet  a  brief  look  at  the  assumed  system  structure  and 
nature  of  the  solution  illustrate  the  close  connection  of  Wiener  filtering 
to  the  popular  Kalman  techniques . 

Kalman  presupposes  a  finite-dimensional  state-space  structure,  which 
is  in  general  time  varying,  but  driven  by  white  noise. 


A(t)Xj.  +  , 

t  >  t 

o 

(2.1.44) 

C(t)x^  +  9^  , 

t  >  t 

o 

(2.1.45) 

and  9^  are  (nxl)  and  (m^l) ,  respectively,  vector  zero  mean  white  noise 
processes  such  that 


-  S^(t)6(t-T), 

E{9^  93}-S  (t)6(t-T) 

C  T  0 

E{9^  5^}  •  0. 


(2.1.46) 

(2.1.47) 

(2.1.48) 


S,  and  S  are  non-negative  definite  time-varying  constant  matrices  in  accor- 
dance  with  the  white  noise  requirement,  is  the  n^l  state  vector  and  y^ 
the  mxl  observation  vector.  A(t)  and  C(t)  are  suitably  dimensional  matrices 
of  time  functions.  This  type  of  structure  is  frequently  encountered  in 
many  applications.  Using  state  augmentation  methods  (see  Kwakernaak  and  Sivan 
[9]),  it  may  accommodate  linear  systems  driven  by  a  noise  process  which  is 
not  white,  but  can  be  represented  by  the  output  of  a  finite-dimensional  linear 
system  driven  by  white  noise. 
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Kalman's  solution  consists  of  a  dynamic  system  of  the  form 


=  A(t)x^  +  L(t)  [y^  -  C(t)x(t)  ] ,  tit^  (2.1.49) 

x(0)  =  0  (2.1.50) 

where  L(t)  is  given  by 

L(t)  -  Z(t)c’^(t)(SQ(t))‘^  (2.1.51) 

for  t>t  ,  and  S(t)  is  the  solution  to  the  matrix  Riccati  equation 
o 

E(t)  -  A(t)  Z(t)  +  Z(t)A''^(t)  +  S^(t)  -  Z(t)C^(t)S'^(t)C(t)Z(t)  (2.1.52) 

with  boundary  condition 

Z(t)*S_(t).  (2.1.53) 

o  Co 


It  is  interesting,  to  note  the  connection  between  the  time- 
invariant  causal  Wiener  filtering  scheme  presented  for  stationary  second- 
order  processes  and  the  Kalman-Bucy  filter.  Although  the  causal  Wiener 
filtering  arguments  were  developed  on  the  assumption  that  the  noise  processes 
are  of  second-order,  slight  modifications  to  the  same  arguments  show  that  the 
same  results  also  apply  to  stationary  white  noise  processes.  Consequently, 
there  is  a  class  of  problems  to  which  both  methods  may  be  used.  These  problems 
are  time-invariant  with  stationary  process  and  observation  noises  (required 
for  Wiener  solution) ,  and  linear  and  finite  dimensional  with  white  process 
and  observation  noises  (required  for  Kalman  solution).  For  these  problems, 
the  steady-state  (t  >>  t^)  Kalman  solution  approaches  the  causal  Wiener 
solution  (recall  that  for  Wiener  filtering  t  ■  -*,  so  until  t  -t  ■  the 


solutions  will  differ) . 
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The  entire  preceding  discussion  of  optimal  filtering  has  been 
presented  in  order  to  review  well-known  techniques  of  filtering  an  observa¬ 
tion  process  to  obtain  an  estimate  of  a  state  process  in  the  presence  of 
random  additive  noise  in  both  state  and  observation  assuming: 

i)  A  reasonable  model  of  the  system  dynamics  is  available, 

ii)  The  relationship  between  the  state  process  of  the  system  and  the 
observed  process  is  known. 

iii)  The  noise  processes  are  second-order  and  have  known  second-order 
statistics . 

Various  additional  assumptions  on  the  nature  of  the  problem  lead  to  different 
methods  of  analytical  solution.  Also,  the  state-space  description  which 
provides  a  valuable  internal  description  of  a  system  is  easily  accommodated 
in  each  of  the  procedures  mentioned.  Frequently,  the  state  and  observation 
dynamics  are  well  understood,  but  assuming  that  the  second-order  statistics 
of  the  noise  processes  involved  are  known  exactly  may  be  somewhat  naive 
from  a  design  standpoint.  Consequently,  a  superior  filter  might  be  sought 
which  provides  acceptable  error  performance  over  a  range  of  anticipated  noise 
process  statistics. 

2.2.  One- Dimensional  Robust  Wiener  Filtering 

Most  of  the  work  published  to  date  on  optimal  robust  filter  design 
is  concerned  with  estimating  a  scalar  state  process  from  a  scalar  observation. 
Some  of  the  significant  results  are  presented  in  this  section. 

The  one-dimensional  system  model  has  the  form 

Ft  ■  (8g(t)  *  x(t))  +  9^ 


(2.2.1) 
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*  ^t’  (2.2.2) 

where  an  asterisk  indicates  the  convolution  operation 

OQ 

g^(t)*5(t)  =■  /  g^(a)§(t-a)do,  (2.2.3) 

X  X 

—CO 

and  all  quantities  are  scalars.  The  input,  C(t)  and  observation,  9(t)  scalar 
random  processes  are  second  order,  and  x(t)  is  the  process  to  be  estimated. 
The  primary  purpose  for  considering  such  a  model  is  to  allow  the  estimation 
of  an  internal  system  quantity.  For  instance,  the  problem  of  estimating  one 
element  of  the  state  vector  of  a  finite  dimensional  system  as  in  equations 
(2. 1.32) -(2. 1.36)  fits  this  formulation.  Therefore  x^  will  henceforth  be 
referred  to  as  the  state  process,  though  it  may  or  may  not  correspond  to  all 
or  part  of  the  system  state  vector. 

Any  systems  of  this  form  are  suitable  for  Wiener  filtering  since 

Sxy(oj)  -  |G^(ja))|^S^(u))[G^(jui)]“  (2.2.4) 

Sy((*))  >  |G^(ja))G^(ja))|^S^(co)  +Sq((*))  (2.2.5) 

are  expressed  in  terms  of  the  noise  process  PSD's,  S  (u)  and  S  (oj)  .  The 
superscript  denotes  the  Hermltlan  transpose  (complex  conjugation  in  the 
scalar  case  here) ,  and 

|G(ja))l^  -  G^(jw)G(ju)).  (2.2.6) 

A  useful,  albeit  conservative  definition  of  the  optimal  robust 
filter  is  the  mlnlmax  estimator.  The  mlnlmax  filter  minimizes  over  all 
allowable  filter  structures  the  worst  case  mean-square  error.  Stated  more 
formally,  the  estimator  has  a  transfer  function  given  by 
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■  arg  min{  anax  a(H,S  ,S  )}.  (2.2.7) 

ti  9 

3C  indicates  the  set  of  allowable  filter  structures .  In  light  of  the  earlier 
discussion,  two  useful  classes  for  JC  are  the  sets  of  causal  transfer  functions 
and  the  set  of  non-causal  transfer  functions.  and  ^  ,  respectively 
comprise  the  sets  of  power  spectra  to  which  S^(ai)  and  are  expected  to 

belong. 

A  central  issue  in  such  a  robust  design  procedure  is  the  establish- 
metn  of  appropriate  spectral  classes  and  ^  for  the  particular  problem  at 
hand.  Though  many  possible  classes  are  conceivable,  a  few  ways  of  specifying 
spectral  classes  have  come  into  common  use  in  robtist  filtering  for  various 
analytical  and  physical  reasons. 

Consider  designing  a  filter  for  a  one-dimensional  plant  that  is  to 
be  produced  on  an  assembly  line.  Suppose  that  the  sensor  noise  alone 
constitutes  the  entire  observation  noise  process,  and  that  each  sensor  may 
be  tested  before  assembly,  and  the  failed  units  discarded.  A  reasonable 
test  of  the  sensors  might  measure  the  noise  power  at  the  sensor  output  and 
require  that  the  total  noise  power  not  exceed  a  predetermined  maximum.  To 
ensure  acceptable  frequency  response  performance  of  the  units,  an  upper 
bound  on  the  sensor  noise  spectrum  might  be  placed  at  each  frequency.  Such  a 
physical  application  motivates  one  model  for  defining  spectral  classes  known 
as  the  Spectral-Band  model  [4].  More  precisely,  a  spectral  class  ^  may  be 
identified 


{Sg(u))  |Sj^(w)  <  Sg(ui)  s  Sy(uj)  ,  —  f  s^(ui)du>  “  Pq>- 


(2.2.8) 
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E 


■ 


The  first  condition  establishes  confidence  limits  between  which  S  (co)  is 
expected  to  lie  for  all  uj.  The  second  condition  specifies  the  overall  noise 
power.  Obviously  this  restriction  is  required  for  a  minimax  procedure  to 
provide  solutions  other  than  trivial  results  like:  the  greatest  noise  power 
is  least  favorable  for  filtering,  therefore  the  least  favorable  spectrum  is 

S  (cj)  =  S  (ui)  . 

0  u 

Now  consider  an  entirely  different  design  setting  -  a  suitable 
spectral  class  for  the  state  noise  is  to  be  chosen  when  the  state  process 
consists  of  a  signal  received  through  a  communication  channel.  The  state 
process  noise  might  be  expected  to  consist  of  a  background  band-limited  white 
Gaussian  noise  and  additional  noise  from  interfering  channels  and  the  like  of 
unknown  spectral  form.  In  this  situation  a  mixture  model  more  accurately 
fits  the  application 

09  eo 

{S  (aj)|(l-e)Sjj(oj)  +  eS^(a)),  ^  /  Sjj(u))da)  =  ^  /  S^(a))da)  =  P  } .  (2.2.9) 

e  is  a  parameter  which  can  be  chosen  in  accordance  with  an  estimate  of  the 
ratio  of  noise  powers  in  the  known  nominal  spectrian  Sjj(u)  and  unknown  con¬ 
tamination  spectrum  S^Cu) .  Again  the  power  constraint  is  Included  to  effect 
meaningful  solutions . 

Another  type  of  spectral  class  based  on  a  nominal  spectrum  which 
does  not  require  a  lower  spectral  bound  is  the  total-variation  model.  Good 
for  significant  analytical  mileage  (see  Poor  [5]),  it  is  stated 

Jt-  {Sj(o)|^/  |Sj,(u)-S^(u)|du<ej,  /Sj(u)du  -  P^}.  (2.2.10) 


e 
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The  task  of  identifying  appropriate  spectral  classes  for  a  design 
is  by  no  means  trivial  and  greatly  determines  the  relevance  of  the  analysis . 
Furthermore,  for  a  particular  situation,  none  of  these  analytically  expedient 
models  may  suffice.  Yet  the  aim  of  this  paper  is  not  to  discuss  all  of  the 
design  possibilities,  but  to  develop  techniques  for  extending  one-dimensional 
robust  filtering  problems  to  the  multivariable  setting.  From  this  point 
onward,  discussion  and  illustrative  examples  will  center  around  the  spectral- 
band  model,  partially  due  to  its  physical  significance,  but  mostly  on  account 
of  its  analytical  convenience.  The  relationship  between  the  different 
spectral  class  models  and  their  corresponding  solutions  is  treated  in  more 
detail  by  Kassam  [10]. 

Now  that  the  minimax  problem  formulation  has  been  completed,  a 
method  of  solution  is  required.  The  error  expression  for  one-dimensional 
time  invariant  problems  of  the  form  (2. 2.1) -(2. 2. 2)  is  given  by 

00 

a  =  /  |l-H(ju)G^(ja))l^lG^(ja))l^S  (uj)  +  |H(ju))  1  (u))da).  (2.2.11) 

This  follows  directly  from  equation  (2,1.43).  Since  S^((jo)  is  a  function  of 

S-(a)),  the  error  is  a  function  of  H,  S  ,  and  S  .  The  minimax  problem  may  be 
s  5  9 


written 


min  {  max  &(H,S  ,S  )}. 
HSJf  (S^,Sg)€*x?i  ^ 


(2.2.12) 


This  type  of  problem  requires  that  both  the  maximization  and  minimization  be 
performed  simultaneously.  The  following  well  known  theorem  of  Barbu  and 
Precupanu  [11]  states  that  saddlepoint  solutions  to  the  minlmax  problem  also 
are  saddlepoint  solutions  to  the  associated  maxlmln  problem 


20 


max  {min  a(H,S  ,S.)} 

(S^,Sg)ejftxi»f  H€3f  ^ 


(2.2.13) 


for  convex  spectral  classes  X  and 

R  R  R 

Theorem  2.1:  There  exists  a  triplet  (H  .S_ .S,)  S x  A x ^  satisfying  the 

4  a 

saddlepoint  condition 


S(H^,S^,Sg)  <  a(H^,S^.Sg)  <  £(H,S^,Sg)  for  all  HeJf  . 


(2.2.14) 

if  and  only  if  the  solutions  of  the  minimax  and  maximin  problems  are  equal. 

R  R  R 

The  triplet  (H  ,S_,S«)  is  the  solution  to  both  problems. 

Proof :  See  [11]. 

This  theorem  greatly  simplifies  the  robust  filtering  problem  in  that  if  a 

solution  to  the  maximin  problem  may  be  found  which  satisfies  the  saddlepoint 

condition,  it  also  forms  a  solution  to  the  minimax  problem  of  interest.  The 

triplet  solution  consists  of  the  optimal  filter  transfer  function,  and  a 
R  R 

pair  of  spectra  S.  and  which  may  be  called  least  favorable  for  Wiener 
filtering. 

Recall  from  the  first  section  of  this  chapter  that  for  time- 
invariant  Wiener  filtering  in  both  the  causal  and  non-causal  cases,  the 
optimal  filter  transfer  function  is  a  solution  to  the  bracketed  quantity  of 
the  maximin  problem  and  may  be  written  in  terms  of  S  and  S  .  This  property 
of  the  optimal  filter  effectively  separates  the  maximin  problem  into  two 
separate  extremal  problems  and  gives  an  immediate  solution  to  the  inner 
minimization.  The  maximin  problem  then  is  reduced  to 


max  {a(S  ,S  )} 

(S^,Sg)€.*xn  ^ 


(2.2.15) 


\  • 


with  the  appropriate  expression  for  inserted  in  the  error  expression. 

This  technique  is  useful  in  solving  many  robust  filtering  problems .  Using 

this  type  of  reasoning,  Kassam  and  Lim  have  found  non-causal  solutions  for 

problems  with  spectral  band  and  mixture  model  spectral  uncertainties  [4],  and 

Poor  has  done  the  same  for  total  variation  models  [5].  The  causal  problems 

do  not  provide  a  general  explicit  error  function  &(S_,S-)  for  use  in  equation 

(2.2.15),  so  solutions  to  robust  causal  problems  may  only  be  found  in  specific 

Instances  for  which  such  an  error  expression  exists.  Poor  has  demonstrated 

2 

solutions  when  either  S.  or  Ig  I  S_  is  known  and  wide-sense  Markov  [5]  or  white 

9  '  y'  5 

(Poor  and  Looze,  [6]),  as  well  as  a  number  of  other  specific  problems  [5,12]. 
Kassam  and  Lim's  non-causal  spectral-band  result  [4]  is  of  fundamental 
significance  to  this  paper  and  is  stated  almost  word-for-word  it:  -he  Apf.S’’*,4ix. 
The  robust  pair  of  spectra  found  by  their  method  have  intuitivaiy  satisfying 
properties  which  might  be  expected  of  least  favorable  spectra  for  filtering. 
Particularly,  note  that  in  the  regions  of  the  frequency  spectrum  where  the 
upper  or  lower  bounds  of  the  uncertainty  model  are  not  encountered,  the 
robust  spectrum  is  proportional  to  one  of  the  bounds  on  the  other  process  (in 
cases  a  and  c) . 

To  illustrate  this  solution,  consider  the  following  example: 


y  •  X  +  9 
■'t  t  t 


(2.2.16) 


(2.2.17) 


S„(t)  - 


(2.2.18) 
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I 


Then 


(2.2.19) 


Assume  that  the  process  noise  ^  is  white  and  of  unit  spectral  height 


(S^(a))  »  1,  Yoj)  ,  and  the  observation  process  noise  9  is  knoim  to  lie  within 


a  spectral  band  model 


(2.2.20) 


01+1  01+1 
OD 

i/  SjWi.  .  P.. 


e 


(2.2.21) 


By  case  A  of  Theorem  A.l  (in  the  Appendix),  the  least  favorable  observation 
noise  spectrum  is  then 


s^»)  -  2 


8 


(2.2.22) 


u'+ie 


s*{») 


(1/k  )S  <N.  (u>) 
n  X  L 


(  (f)s,(<-). 

n 

N 

u 


N,  (uj)  <  (1/k  )S  <  N  ((d) 
L  n  X  u 


(2.2.23) 


(1/k  )S  >  N  ((d) 
n  X  u 


where  k^  is  chosen  to  satisfy  the  power  constraint  of  equation  (2.2.21).  The 


robust  spectrum  if  P  ■  .847,  for  instance,  is  shown  in  Figure  2.1  of  the 

0 


following  page  as  a  heavy  solid  line  (for  which  k^«l).  The  robust  non-causal 


filter  is  given  by 


H^(j(D) 


S^((d) 

X 


S^((d)  +  sJ((d) 

X  V 


(2.2.24) 


Calculating  values  when  k^  •  1 , 


j 


3 


(-3 


0)1  <  1.07 


^  r0i_+i_1 
1  I- 


1.07<  |o)l  <  2.83  >  (2.2.25) 

ri 

|o)|  >  2.83 

/ 

and  the  solution  is  complete. 

Summarily,  the  procedure  for  solving  minimax  robust  estimation 
problems  is  conceptually  routine  once  the  relationship  between  the  minimax 
and  maxlmin  problems  is  recognized.  Useful  results  may  be  obtained  for 
non-causal  problems  under  several  different  spectral  uncertainty  models. 

Similar  extensions  to  causal  problems  do  not  follow  directly  from  the  maximin 
problem,  for  lack  of  a  closed-form  expression  for  the  mean  square  filtering 
error  in  terms  of  the  process  and  observation  noise  spectra.  Consequently, 
results  may  be  obtained  only  for  special  cases  in  which  such  error  expressions 
can  be  found.  Specific  results  have  been  presented,  for  a  non-causal  spectral 


H^Cjo)) 


30)  +8 


24.1 

8  [-^4^], 

llo)  +56 


band  problem  for  purposes  of  the  subsequent  multiple-state  discussion. 
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3.  MULTIPLE-STATE  ROBUST  ESTIMATION 

This  section  is  concerned  with  extending  one -dimensional  robust 
filtering  techniques  to  higher  dimensional  problems.  A  particular  multiple- 
state  model  is  presented  and  justified  as  reasonable  for  a  first  investiga¬ 
tion  into  multivariable  robust  filtering.  Two  multiple-state  minimax  for¬ 
mulations  are  proposed  for  finding  multiple- state  estimators.  Equivalence 
of  the  solutions  to  the  different  formulations  is  established  for  systems 
which  fit  the  multiple-state  model  without  causality  constraints  on  the 
filter  structure  and  for  which  the  noise  processes  are  specified  by 
spectral-band  models,  and  a  design  procedure  follows  directly.  For  other 
types  of  non-causal  problems  a  more  general,  though  slightly  less  com¬ 
putationally  expedient  method  is  devised.  Analogous  causal  results  (or 
lack  thereof)  are  discussed  briefly;  an  investigation  of  the  error  bounds 
associated  with  the  various  methods  concludes  the  section. 

3.1.  The  Multiple-State  Model 

The  system  model  to  be  used  throughout  this  section  may  be 
represented  in  the  time  domain  by  the  following  equations: 

x(t)  -  g^(t)  *  5(t)  (3.1.1) 

and 

y(t)  -  (gg(t)  *  x(t))  +  9(t).  (3.1.2) 

Again  h  denotes  time-domain  convolution.  |(t),  9(t)  and  y(t)  are  scalar 
processes.  9(t)  and  S(t)  are  either  second-order  or  white.  x(t)  is  an 
n-dlmensional  "state-process"  vector,  and  gj^(t)  and  g^(t)  are  compatibly 

dimensioned  impulse  response  functions.  Additionally  5(t)  at'd  9(t)  are 
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zero  mean  and  uncorrelated  so 

E  9t  }  -  0 

(3.1.3) 

3  [  E  Ut  5^  } 

SpCm) 

> 

(3.1.4) 

and 

3  [  E  9^  } 

SjW  , 

(3.1.5) 

for  all  t,  T  €  R. 

A  more  universally  applicable  model  would  allow  for  vector  noise 
processes  and  correlation  between  process  and  observation  noises.  There  are 
several  drawbacks  with  such  a  general  model.  The  calculations  become  rather 
cumbersome  when  vector  noise  processes  are  considered  (particularly  the 
spectral  decompositions  involved  in  causal  problems),  and  could  unnecessarily 
obfuscate  the  character  of  the  problem.  Before  vector  noise  processes  may 
be  studied,  more  elaborate  matrix  spectral  uncertainty  classes  must  be 
established,  while  scalar  noise  processes  may  be  studied  using  the  spectral 
classes  already  established  for  one-dimensional  robust  filtering.  The 
multiple-state  model  is  therefore  a  most  attractive  one  for  the  investiga¬ 
tion. 

The  multiple-state  model  nonetheless  includes  a  large  variety  of 
problems.  Any  systems  represented  in  state-space  form  (see  eqns. (2.1.32- 
2.l.36))  fit  this  model,  and  the  impulse  response  matrices  may  be  identified 


g^(t)  -3‘^CG^(juu)}  -3"^{(J<oI-A)~S}, 


(3.1.6) 
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g^(t)  =3"^  {G^(ju))}  -  C6(t), 


(3.1.7) 


and 


*  8-(t).  (3.1.8) 

y  X  c 

Such  representations  frequently  apply  to  practical  problems,  the  double 
Integrator  plant  example  of  Section  4  for  example  Is  In  state-space  form. 

3.2.  The  State-.bv-State  and  Least-Squares  Formulations 

Now  that  the  multiple-state  system  to  be  considered  has  been 
established,  the  mlnlmax  robust  filter  problem  may  be  stated.  Since  the 

A 

quantity  (x-x)  Is  a  vector,  two  definitions  of  the  most  robust  filter  may 
be  presented.  The  robust  filter 


(3.2.1) 


may  be  designed  by  selecting  Hj^(j!i])  to  minimize  the  worst  case  error  In 

^1’  minimize  the  worst  case  error  In  x^,  and  so  on.  A  filter 

which  satisfies  this  requirement  will  be  called  state-by-state  robust. 
Alternatively,  a  robust  filter  may  be  defined  as  one  which  minimizes  some 
vector  norm  of  (x-x).  The  most  general  mean-square  norm  Is 


H^(Jm) 


Hj(j<i)) 

H2(j<«) 


H^(j(*i) 


S  -  E  Q(x-x)}.  (3.2.2) 

For  the  purposes  of  this  paper,  attentioa  will  be  restricted  to  problems 
where 

Q  -  I.  (3.2.3) 

Most  of  the  results  obtained  may  be  applied  with  minor  modification  for 
all  positive  semi-definite  weighting  matrices  Q,  but  the  notation  becomes 
inconvenient  and  adds  little  to  the  results.  This  case  corresponds  to 
minimizing  the  sum  of  the  squares  of  the  state  errors,  and  will  henceforth 
be  referred  to  as  a  least -squares  robust  problem.  It  is  a  special  case  of 
the  more  general  norm-wise  robust  formulation. 

In  either  case,  the  robust  filter  is  given  by  equation  0*2.1) . 

A  state-by-state  robust  filter  satisfies 

min  /  max  E  [(x.-x  )^]  "V.  (3.2.4) 

(Sg,Sg)  €  ^  ^ 

Calculation  of  this  robust  filter  involves  solving  n  one -dimensional  mini¬ 
max  problems  by  methods  similar  to  those  of  Section  2 .  The  least-squares 
robust  filter  problem  may  be  stated 

min  •[  max  E  [ (x-x)  (x-x)]  |  (3.2.5) 

H(j(D)  6  3(f  (S,,S„)  €  ZxTl 

9  9 


This  formulation  is  quite  attractive  since  it  involves  a  single  m inimax 
problem  and  reflects  the  quadratic  cost  criterion  used  extensively  in 
control  theory  literature.  However,  such  a  formulation  cannot  be  solved 
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using  one-dimensional  techniques  directly.  The  relationship  between  state- 
by-state  and  least-squares  formulations  and  their  solutions  is  central  to 
an  adequate  robust  design  procedure. 


3.3.  Solution  of  Non-Causal  Problems 

This  section  is  divided  into  two  subsections.  In  subsection 
3.3.1  a  general  approach  is  established  for  solution  of  the  state-by-state 
formulation.  Subsection  3.3.2  deals  specifically  with  the  application  of 
this  method  to  spectral-band  problems  and  the  implications  of  the  result. 


3.3.1.  General  State-by-State  Solution 


The  one-dimensional  problems  discussed  in  Section  2  each  resulted 


in  maximin  problems  of  the  form 


^  fn  |^S^+lH(ju))  I^Sgdu}. 


(S^.Sg)  €  €  K 


(3.3. 1.1) 


Solution  of  the  non-causal  minimization  gives 
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-.-{2“^  £»l^'^opt^-^<"^l\-^l^opt^j“’>l^V“}.  (3. 3. 1.2) 


(s^.Sg)  ^x,n 


where 


S  +  S« 
X  9 


(3. 3. 1.3) 


Saddlepoint  solutions  for  this  problem  are  already  established  for  many 


different  spectral  class  models.  The  solution  for  spectral-band  models 


is  presented  in  the  Appendix  in  some  detail. 

The  state-by-state  formulation  produces  n  maximin  problems  of 

the  form 


max 


H  G  I^s^+Ih  I^s  duj}  (3. 3. 1.4) 


(S,,S.)  €  Zx7l  "  H,  €  K 

s  0  1 


wich  the  transfer  function  between  the  input  5^  and  the  state  x^, 


and  G  che  transfer  function  from  |  to  y.  Factoring  G  from  the  first 
y  t  Xj 


term  of  the  integrand, 


(S, 


.  3  G 

/  1  Ml  y  1 

1  2  1  1 2  .  1  1  2  ^ 

G  |2  . 

X,  '  .  \ 

1.  min  TF'Ui '  G  i' 

1  Xi  1 

G  ,2 

H.  (jm)€:<  H 

y  i 

This  is  exactly  the  form  of  aquation (3.3.1)  if  the  following  quantities  are 
identified ; 


Hi(jjj)  4 


(3.3. 1.6) 


(ju;)  4  I  G  r  S,(i,), 

Xi 


(3. 3. 1.7) 


W  4  J-i-  Sg(m), 


"i 


S  I' 


(3. 3. 1.8) 


^  {  S  ;  S 


V  V 


(u))  -  rs 


„  s,€3:} 


(3. 3. 1.9) 
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7?  -  {  Sg:  Sg  (aj)  *  Sg,  Sq€7z}, 


(3.3.1.10) 


G  |2 

y 


where  X  and  7?  are  the  spectral  uncertainty  classes  of  the  original  problem. 
Solving  the  "tilde"  one-dlmenslonal  problem  by  one-dlmenslonal  methods,  such 
as  using  Theorem  A.l  (see  Appendix)  for  spectral  band  problems,  gives  a  solu- 
tlon  triplet  [H  ,S  ,5^  ].  The  corresponddLng  solution  In  the  original  coor- 

Xi  0^ 

dinates  may  be  found  using  equations  (3.3.1.6)-(3.3.1.10)  to  give  the  maxlmln 

R  R  R 

(and  mlnlmax)  solution  to  the  original  problem,  [H. ,  S  >  S.  ] . 

1  Xj^  0^ 


3,3.2,  Solution  for  Spectral-Band  Uncertainty  Models 

Consider  non>causal  spectral-band  problems,  where  X  and  71  are 

tm 

spectral  uncertainty  classes  of  the  fom  of  equatlon(2.2.d  .  X  and  7[  are 
then  also  spectral-band  classes  with 


(3.3.2. 1) 


(3. 3. 2. 2) 


(3. 3. 2. 3) 


and 


(3. 3. 2. 4) 


The  solution  to  the  one-dlmenslonal  tilde  problem  (3.3. 1.2)  then  Is  given  by 
Kassam  and  Llm's  theorem  (Theorem  A.l  of  the  Appendix).  Each  of  the  three 


possible  cases  will  be  considered  here. 

Case  A.  Consider  non-causal  spectral-band  problems  for  which  gives 

a  least  favorable  spectral  pair  for  the  tilde  problem  of  the  form 


S  ,  m  €  a  (K  ) 

Lf  1 


s  (m) 

^1 


K_  N  ,  CD  6  a  (K  ) 

Sf  i. 


(3. 3. 2. 5) 


S  .  »  €  0,  (K  ) 

1  11 


N-  ,  (ju  €  &  (K  ) 
Lf  1  n^ 


(1/K  )S,  .  u)  €  0,  (K  ) 

“l  h  ^1  *^1 


N.,  ,  ou  €  0,  (K  ) 
^1  ^1  '^l 


(3. 3. 2. 6) 


Using  equations  3.3.7  -  3.3.10 


IG  -S* 

*1  X 


l%l  V 

|G  |2 

I  x,l 

K„  -r^2  N  ,  uj  €  or  (K  ) 
Si  G  L  l^ 


(3.3.2. 7) 


- N  ,  <u  €  0 .  (K  ) 

'  "1 


*1 


v««  w 


(3. 3. 2. 8) 


«  6  8  (K  ) 

V  *  * 
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The  state-by-state  solution  triplet  then  consists  of  the  least  favorable 
spectra 


_R  .  . 

S-  (tu) 

^i 


L. 


K. 


■9  » 

\2.  L 


■'u 


S  <  N  <  s  (3. 3. 2. 9) 

L  .2  L  U 

I  yl 


\  ^  "l 

I-  |2 


and 


iSl' 


%  ' 


G 


N  >  - ^ 

L  K  L 
n 


G  j2 

^  “u 


u 


(3.3.2.10) 


(Kg  is  the  same  for  each  state  by  the  power  constraint)and  the  robust 
filter 


G*S? 

y 


(3.3.2.11) 


which  follows  from  equation (3.3. 1.3).  Note  that  the  state  index  i  does 
not  appear  in  the  expressions  for  the  robust  spectra. 

Case  B.  For  problems  with  tilde  solutions  which  fall  under  "case  b"  of 
Theorem  A. 1,  similar  arguments  can  be  made.  The  resulting  solutions  are 
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n 


Sf  («) 


K 


— ,  N_  +  - S  ,  du  €  a,  (K) 

|2  L  |2  L_, 


G  r 

V 


u)  €  a  (K) 


S,  +  I  S  ,  (1)  €  Si  (K) 


|2 


L  . 


1. 

1 


0)  €  S,  (K) 
i 


(3 


and 


«''3 


=  < 


G  i2 


y 


% 


I  - 

N  >  0)  €  S,  (K) 

e 


S  + 
L 


1%!' 


G, 


G, 


2  e 


aJ  €  S,  (K) 
i 


(D  6  a  (K) 


u>  €  a  (K) 


with  the  filter  given  by  equation  0.3,2.11).  From  the  theorem,  it  is 
that 


(0))  -  K,  N  (uu). 

®i  ^  ®i 


If  the  functions  S  (tu)  and  N  (uu)  are  defined 
®i  ®i 


.3.2.12) 


.3.2.13) 


required 


(3.3.2.14) 


(3.3.2.15) 


(cu) 


I 


N  ((ti)  =  - - N  (to)  . 

G  ® 


(3.3.2.16) 


then  the  least  favorable  spectra  may  be  written 


"T  N-  +  S  , 
|2  L  e 


to  €  a^(K) 


Se  (uJ) 
^1 


to  6  Qf2  (K) 
to  €  3j^(K) 


(3.3.2.17) 


u)  €  @2  (K) 


S-  +  |g  N  ,  to  €  3.  (K) 
L  ye  i. 


Se  <“) 
®i 


\  l<5yl  ^  > 


tu  6  32  (K) 


to  €  Qfj^(K) 


(3.3.2.18) 


to  6 


Again  the  regions  a^,  3^  and  remain  invariant  under  the  transformation 
and  K  Is  the  same  for  each  state  by  the  power  constraint,  so  once  again  the 
least  favorable  spectra  do  not  depend  on  the  state. 

Case  C.  For  these  problems  the  final  solutions  for  the  least  favorable  spectra 
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I'  * 


s|  (u)) 


UB  €  b2(‘2g) 


G 


Sy,  UJ  €  b(Xg) 


(3.3.2.19) 


and 


Sq^((u) 


\  • 


«)  6  a^Ci^) 


[G^|2 

-/-  Sy  .  a.  6  a^(X^) 


(3.3.2.20) 


I  Ny  • 


u)  €  a(2  ) 
n 


The  point  to  be  made  is  that  for  each  of  the  three  possible  saddle- 
point  solutions  consisting  of  a  least  favorable  spectral  pair  given  by 
(3.3.2.)  and  (3.3.2.10),  (3.3.2.17)  and  (3.3.2.18)  or  (3.3.2.19)  and  (3.3.2.20)  and 
robust  filter  structure  given  by  0.3.2.11) , the  least  favorable  spectra  ^ 
apt  depend  oa  1  at  all.  Therefore,  the  least  favorable  spectra  pair  [S-  , 

$0  ]  is  the  same  for  all  i,  and  may  be  denoted  simply  [S^,  S^] . 

This  observation  leads  directly  to  a  theorem  concerning  the 
relationship  of  the  state-by-state  and  least-squares  solutions  of  this 
particular  problem. 

Theorem  3.1 

For  multiple-state  systems  of' the  type  described  in  Section  3.1, 
with  ^  and  72  given  by  spectral  band  uncertainty  models,  and  K  the  class  of 
noa-causal  linear  filters,  the  solutions  to  the  state -by- state  and  the 
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least-squares  problems  are  equal. 

Proof;  Define  as  the  sum  of  the  maximin  errors  due  to  each  state  in 


the  state-by-state  approach 


Jcs  a  ial  ^ 

(S-  ,  S-  )€  ZxV.  H.ejc 

h  ^ 


{  min  E  {(X  -x.)^}  }.  (3.3.2.: 


By  the  arguments  presented  above,  maximization  occurs  for  [S-  ,Sg  ]“[S_,Sq] 

^i  i  ^ 

for  each  state  independent  of  i,  therefore 


S  max  \  min  E  {(x.-x.)^}  \ 

(Sj,Sg)e;Cx7J  *“  H^€5C  ^  ^  J 


(3.3.2.22) 


(Sg,Sg)€%x 


2  min  E  [(x  -x 
V.  H^63C  ^  ^ 


(3.3.2.23) 


Furthermore 


{  min  „  E  {  .2  (x  -x  )^}  (3.3.2.24) 


(S|,Sg)€%x7|  H€3C  r-i  *  ^  / 

which  is  precisely  the  least-squares  formulation.  It  follows  immedeately 
that  whenever  the  least  favorable  spectra  are  the  same  for  each  state's 
maximin  problem,  the  state-by-state  and  least-squares  solutions  are  iden¬ 
tical.  This  completes  the  Proof. 

A  convenient  design  procedure  follows  immedeately  from  these 
results.  For  multiple-state  non-causal,  spectral-band  problems,  the 
least  favorable  spectral  pair  may  be  found  by  solution  of  any  one  of  the 
state-by-state  formulation's  maximin  problems  using  Theorem  A. 1.  The 
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resulting  spectral  pair,  used  In  equation  (3. 3.2 . 11}  with  the  appropriate 
transfer  functions  gives  directly  the  robust  filter's  transfer  function 
for  each  state 

It  should  be  mentioned  that  all  of  this  procedure  applies 
equally  well  to  &  -  band  (mixture)  model  spectral  uncertainty  classes  as 
well,  since  they  are  a  special  case  of  the  more  general  spectral-band 
model. 


3.4.  Direct  Solution  of  the  Least-Squares  Non-Causal  Problem 


The  preceedlng  section  established  a  method  of  finding  the 
state-by-state  and  least-squares  robust  solutions  for  non-causal, 
spectral-band  model  cases.  An  alternative  means  of  determining  least- 
squares  non-causal  solutions  may  be  applied  to  all  types  of  spectral 
classes,  and  leads  to  a  slightly  modified  design  procedure. 

The  least-squares  maxlmln  problem  is  stated 


(S^,Sg)€2;x7i  '•  H(juj)63C 


{  min  E  [(x-x)^(x-x)]  }. 


(3.4.1) 


Equation  (2 . 1.43 )of  Chapter  2  gives  the  error  expression  for  the  bracketed 
minimization. 


1  ^ 

£  (S..S„)  -  -r—  tr  [  r  [I  -  H  G  ]  S  [I  -  H  G 

opt  I  0  2  TT  •'-<»  •'  opt  C  X  opt  C 


+  H  H"  dm  ] . 
opt  e  opt 


Recalling  that  G^(m)  Is  a  vector  (nxl),  be  found. 


(3.4.2) 


S  (U))  •  G  S-  G**, 

xy  X  §  y* 


S  (uj) 

y 


S'  S 


(3.4.3) 


(3.4.4) 


and  therefore 


S  («u) 


S  (uj) 

y 


G  S-  g“  s"^. 
X  5  y  y 


(3.4.5) 


Also  note  that 


S,(»)  -  I  aj'  Sj  . 


(3.4.6) 


The  error  expression  may  then  be  expanded  to 


■  “«optW  -  "<\<=Xpt) 


+  tr(H  ^G  S  gV  J  +  tr(H  ^)]  dm. 

opt  c  X  c  opt'  '  opt  9  opt''* 


(3.4.7) 


Computing  each  of  the  terms,  applying  the  trace  Identity 


tr[AB}  -  tr{BA}, 

and  noting  that  tr{D}  *  D  If  D  Is  a  scalar. 


(3.4.8) 


'  « 


1)  tr(S  1  -  tr{G  S,gS  -  tr{G**G  S-}  -  |g  S- 

'■  X'’  ^  X  5  X-*  X  X  §■*  '  x'  I, 


(3.4.9) 


11)  tr{H  ..G  S  )  -  tr{G  S.gV^G  G  S-C**}  -  trfG^G  S.G^s’S  S-} 
opt  c  x^  '■  X  5  y  y  c  X  5  x-*  '■  x  x  5  y  y  y  §■* 


I  G^lSjdGylS^S’^], 


(3.4.10) 


iii)  tr{S  (H  G  r]  -  tr[G  S-G^G^S  G  ]  «  jc  !  S,[G^S*  G  S^] 
'  ^  X  opt  c  *^  '‘xjxcy  yix*^  x  i  y  y  y  i 


kj's.dc/sis;*], 


(3.4. LI) 


iv)  trf(H  G  )S  (H  )®}  »  tr[G  S,g“s‘^G  G  S_G^G^s“^G  S-G^} 
opt  c  X  opt  c'  ^  xlyy  cxjxcy  yix-* 


IgJ^s, 

X  ^ 


_ y  » 


and 


V)  criH  }  -  trtG  S-G®S"^S,S’^G  S?G^} 

opt  -3  opt-'  x^yy  3y  yax" 


The  error  xay  chen  be  wricten 


2.  -L,2 


(s.,so  -  ^  1  -  G  rs-s  ‘r  G  -s- 


opt'  a’  5'  2t 


y  37'  X‘  a 


2.  „-L  |2 


1g  I  S-S 

7  3  7 


|2  s 


S.  djj. 


(3.4.12) 


(3.4.13) 


(3.4.14) 


This  is  exactly  che  form  o£  equation  0.3. 1.2) when  the  tilde  quancities  are 
identified 


(3.4,15) 
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G  G^S-S"^ 
|2  X  y  §  y 


(3.4.16) 


(3.4.17) 


S  (uj) 
X 


s,(«) 


■ 


(3.4.18) 


(3.4.19) 


^  t  t  Sg’  Sg  €2:  }  . 


'x'  J  "I 


(3.4.20) 


^  -  i  Sq  =  Sg 


^  Sg.  Sg  €  71  }. 


(3.4.21) 


This  observation  leads  to  a  direct  method  of  solving  least-squares  robust 
filtering  problems.  Just  as  in  Section  3.3.1,  the  maxlmin  problem 


Oax  \  S  )} 

(S-.S.)  €  Zx7l  >>  opt  s  9  J 


(3.4.22) 


Is  reformulated  as 


(S^,Sg)  6  ZxTl 


•T  e  ,(S  ,sSr. 

-  L  opt'  X  9'J  ' 


(3.4.23) 


Since  the  two  problems  are  equivalent,  a  saddlepolnt  solution  to  the  tilde 
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problem  (equation (3.4.23)) transforms  to  a  saddlepoint  solution  to  the  orig¬ 
inal  maxisiln  problem  (equation  0.4.22))whlch  is  also  a  solution  to  the  mini¬ 
max  problem  (equation (3. 2. 5))by  Theorem  2.1.  This  simple  transformation 
makes  the  solution  of  multiple-state  least-squares  problems  possible  when¬ 
ever  solutions  have  been  found  for  the  corresponding  (tilde)  one-dimensional 
prob lems. 

Rapprochement  of  this  method  with  the  results  of  Subsection  3.3.2 

concerning  spectral-band  models  is  straightforward.  Equations  (3.3.2 . 1) 

through  (3. 3. 2. 19) all  hold  if  the  vector  is  substituted  for  the  scalar 

G  ,  so  the  transformations  of  equations  (3.4.17)-0.4.21)  yield  exactly  the 
*i 

same  results  as  the  transformations  of  eqiiations  (3.3. 1.  6)- (3.3. 1. 10) ,  as 
previously  established  in  Theorem  3.1. 

Section  3.3  began  by  considering  the  state -by- state  formulation. 

In  fact  all  of  Subsection  3.3.1  is  valid  for  any  spectral  classes  for  which 
the  resulting  tilde  problem  may  be  solved.  However,  the  fact  that  the 
least  favorable  spectral  pair  is  identical  for  each  maxlmin  problem  of  the 
state-by-state  formulation  has  only  been  established  for  spectral-band 
problems  (which  include  mixture  model  problems).  Extension  to  other  spectral 
uncertainty  classes  is  not  immedeate,  and  further  research  might  establish 
that  Theorem  3.1  also  applies  to  other  spectral  classes  (such  as  the  total 
variation  model)or  perhaps  to  any  classes  of  spectral  density  functions.  It 
is  conceivable  then,  that  problems  exist  for  which  the  least  favorable 
spectral  pair  is  not  identical  for  each  state  of  the  state-by- state  approach, 
and  the  state-by-state  and  least-squares  formulations  yield  different  filters. 

Before  considering  causal  problems,  it  might  be  helpful  to  sumnarize 


the  non-causal  findings.  For  non-causal  problems,  the  state-by-state 
robust  solution  may  be  found  by  reformulating  each  of  the  n  maxlmln  pro¬ 
blems  In  equation (3.2 .4)  using  the  transformation  of  equations  (3.3. 1.6)  - 
(33.1.10).  The  least-squares  solution  may  be  found  by  using  the  method  of 
Section  3.4.  For  problems  In  which  the  spectral  uncertainty  classes  are 
spectral-band  models,  the  two  formulations  yield  Identical  solutions  and 
a  computational  procedure  is  proposed  In  which  a  single  saddlepolnt  solu¬ 
tion  to  one  maxlmln  problem  of  the  state-by-state  formulation  yields  the 
optimal  filter  and  least  favorable  spectra. 

3.5.  Causal  Problems 

It  would  be  highly  desirable  to  establish  robust  state-estimation 
procedures  for  causal  estimators.  In  this  section.  It  Is  demonstrated  that 
the  methods  used  for  non-causal  design  are  unproductive  In  causal  situations. 

Recall  the  one-dlmenslonal  causal  filter  robust  formulation 


max 


(S^,ig)  €  ^  H(j(D)  € 


2^L«  U  ’  H(jm)|2i^  +  |H(jm)|2ig  dm}. 

(3.5.1) 


Solution  of  the  minimization  yielded 

09 

^  ~  {  2^  Jl®  |H''‘(Juj)|^Sgd(uj- 

(i  .S.)  ^Zxn 


(3.5.2) 


"v.”  O  V.' 


Following  the  derivation  of  Section  3.3,  again  each  maxlmln  pro*- 
blem  of  a  state-by-state  robust  formulation  may  be  written 


f 

max  -I  min 

(Sg.Sg)  €  X'x.n  ^  H^(jaj)  6  k 


^  1  J  |l  -7;^H.|^|g 


1%!' 

— S.  dm 
|G  ® 

I  y  I 


(3.5.4) 


and  the  transformations  (3. 3. 6) -(3. 3.10)  made  to  yield  a  maximization 
Identical  In  form  to  equation  (3.5.1).  The  problem  with  the  transformation 
arises  due  to  the  Identity 


H(j(u)  4 


H.(ja)), 


(3.5.5) 


The  causal  Wiener  filter  result  of  equation  (3.5.3 )determlnes  the  causal 
H(ju))  which  minimizes  the  cost  function,  whereas  H^(jou)  Is  the  function 
which  must  be  causal.  Clearly,  the  transformation  from  equation (3.5.4)  to 
(3.5.1)  does  not  yield  an  equivalent  problem  and  the  solution  to  0.5.1)  Is  not 
generally  a  solution  to  0.5.4). 

Following  this  same  reasoning,  the  direct  least-squares  approach 
of  Section  3.4  i3  also  Invalid  through  the  transformation  and  cannot  be 


used. 


Therefore,  the  design  of  causal  multiple-state  robust  filters 


cannot  be  accomplished  without  significantly  more  elaborate  techniques 
than  presented  here. 


Now  that  some  useful  procedures  have  been  developed  (at  least  for 
non-causal  filters),  the  error  performance  may  be  analyzed  for  the  estab¬ 
lished  designs.  The  minimax  formulation  is  intended  to  minimize  over  all 
possible  filter  structures  the  worst-case  error.  The  best  measure  of 
system  performance  is  naturally  based  on  the  worst-case  estimation  error. 

Consider  first  the  general  non-causal,  problem.  Define  the  fol¬ 
lowing  rms  errors 

e.  “  [  E  {(X.  -  x.)2jjl/2  (3.6.1) 


e 

n 

e^  corresponds  to  the  rms  error  in  estimating  the  ith  state.  When  the 
state-by-state  formulation  is  used,  an  upper  bound  e^  can  be  found  by 
solution  of  the  1th  maximln  problem  for  each  of  the  n  states.  The  vector 
error  e  is  then  bounded  in  n-dimensional  space  by  the  hyperplanes  e^  ■  0 
and  e^  ■  e^  for  i  6  [1,  .  .  .  ,  n] .  When  the  least-squares  approach  is 
used,  the  single  maximln  problem  gives  only  a  bound  on  the  magnitude  of 
the  vector  e,  which  will  be  denoted  |  e  1^. 

Whenever  the  least  favorable  spectral  pair  is  identical  for  each 


46 


of  the  states  using  the  state-by-state  formulation  as  in  spectral-band 
problems,  the  robust  spectral  pair  yields  the  error  vector 

(3.6.3) 

In  this  case,  the  hype rrect angular  region  which  forms  the  error  region  for 
the  state-by-state  filter  is  inscribed  in  the  hyperspheric  region  of  radius 
le|  ^  .  This  phenomenon  is  illustrated  in  two  dimensions  in  Figure  3.1. 

lad 

Theorem  3.1  established  clearly  that  for  such  a  case  the  robust  solutions 
are  identical  for  state-by-state  and  least-squares  methods.  The  obvious 
conclusion  is  that  for  problems  which  have  the  same  least-favorable  spec¬ 
tral  solution  for  each  maximin  problem  of  the  state-by-state  approach,  the 
state-by-state  method  produces  a  tighter  error  bound,,  even  though  the 
filters  are  identical. 

If  the  least-favorable  spectra  are  not  identical  for  each  state's 
maximin  problem,  different  filter  structures  will  be  generated  for  each 
of  the  two  approaches  and  the  only  restrictions  on  the  relationship  be¬ 
tween  the  two  error  regions  are 


I  11  R  -  R 

1®  il  LS  —  ®i  ’  ’ 


and  by  the  least-squares  optimality  of  11^:1^ 


ilel 


LS 


(3.6.4) 


(3.6.5) 


Such  a  case  is  illustrated  in  Figure  3.2 


4.  AN  ILLUSTRATIVE  EXAMPLE- THE  DOUBLE -INTEGRATOR 


PLANT  WITH  SPECTRAL- BAND  UNCERTAINTY 


The  preceeding  chapter  developed  techniques  for  designing  robust 
multiple-state  filters.  The  most  productive  problems  for  consideration 
using  the  concepts  of  Chapter  3  are  non-causal  and  have  noise  process  spec¬ 
tral  uncertainty  specified  by  spectral-band  models.  Accordingly,  the  fol¬ 
lowing  example  is  worked  through  in  hopes  of  clarifying  the  application  of 
the  multiple-state  methods. 

Example  4.1  Double-Integrator  Plant,  White  Observation  Noise  of  Spectral 
Height  Sg,  Process  Noise  in  Acceleration  Only  and  Given  by 
Spectral  Band  Model 


The  problem  is  stated  in  state-space  form 


(4.0.1) 


•f  9 


(4.0.2) 


9  is  white  and  of  spectral  height  Sg.  |  has  spectrum  S^(u))  such  that 

f  00 

S^((»))  €  2;  I  Sj(uj)  :  S^((«)  <  Sg(m)  <  Sy(m),  ^  j'_^S-(a))dm  -  l]-  (4.0.3) 


vhcre 


S  (m)  -  — 5 - 

^  m  +  1 


(4.0.4) 


a 


(U  +  1 


Identify  the  relevant  transfer  functions  for  solution: 


(4.0.6) 


(4.0.7) 


(4.0.8) 


(4.0.9) 


To  solve  the  least-squares  problem  directly,  equations  (3.4.17)  through 
(3.4.19)  give 


S  ((II) 
x'  ' 


and 


SQ(a>) 


G  G 


G  I^S, 

X  '  5 


|G  2 

X 


.5  “fl 


U 


opt 


[  1  -  ju>  ] 


opt 


(4.0.10) 


tu^  +  l 


2 

w  +  1 


m 


(4.0.11) 


Sfl  -  [  m  +  1  ]S, 


(4.0.12) 
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By  case  a  of  Theorem  A.l,  with  *  ®9» 


S^(u)) 


■L  2  * 

^  (1)  +1 


1  4 

2-^  >  ^9 


U)  +1 


* 


1  4 

—  <  K^u)  So  < 


0.2  +  1^  S-9-  ,2^, 


(4.0.13 


u  2  ^  * 

U)  +  1 


3  4 

2-^  <  V  ^9 


U)  +1 


as 


in  equation  (3.3.15).  If  the  power  constraint,  on  the  process  noise 


is  unity,  K-  must  be  chosen  to  satisfy 


2^L  *  1 


(4.0.14) 


That  is 


i  r 

n  J( 


U}l 

1  r  ^ _ L 


0  2^, 
U)  +  1 


du) 


-  f  K  S  dm  +  -  f  — ? -  dm  -  1  (4.0.15) 

TT^mj^'^S  9  TT  Jm„  2  .  , 


"'"Z  m2  +  l 


where  is  given  by 


m  (m  +1) 


Vs- 


(4.0.16) 


and  (1)2  by 


3 

TTl 


m  (m  +1) 


Ve- 


(4.0.17) 


Performing  the  integrations. 


1  S  9 

i  [  arctan  (u^I  +  [ 


ui- 


mj  J  +  ^  [^  -  arctan  0)2] 


1.  (4.0.18) 
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I 
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f-;. 


>  i'’ 

V'^  V 


i;-' 

iii 


Solving  (4.0.16)-(4.0.18)  by  iteration  yields 


(U^  -  .869, 


uu^  ■  1.084. 


The  final  solution  is  then 


S»((u) 


2  ’ 
(U  +l 


U) 


3 

2  ’ 


w+l 


u)  <  .869 


,869  <  (ii  <  1.084 


u>  >  1 . 084 


(4.0.19) 

(4.0.20) 

(4.0.21) 


(4.0.22) 


6  4 

SgUJ  +  SgU)  +  1 


6  4 

SgU)  +  SgU)  +  I 


u)  <  .869 


.869  <  'JO  <  1.084 


(u  >  1.084 


(4.0.24) 


As  discussed  in  Section  3.6,  Che  tighter  error  bound  is  determined  by  using 
the  robust  solution  in  each  state's  maximin  problem  o£  the  stace-by-state 
formulation.  The  worst-case  errors  are  most  easily  computed  through  the 
scate-by-state  tilde  problems. 


,  R-2 


,  R.2 

<‘i> 


U  ■  i  +  |h?|^  i,  dm 

In  J-09  '  1 '  X  '  i '  9 , 


»  x/e. 


2^  L. 


X  9 
i  i 


(4.0.25) 


(4.0.26) 


Using  equations  (3.3.^  and  (3.3.8),  first  for  ^ 

1  ti)^ 


4  2 

0)  (u)  +1) 


1  , 


t»‘^(«J^  4-  1) 


u)  <  .869 


.869  <  <u  <  1.084 


(4.0.27) 


(s  >  1.084 


-  I  . 


(4.0.28) 


S 


e 


aad  then  for  G 

*2 


_1_ 


2/  2  ^ 
(U  (U)  + 


1) 


and 


3 

2  2  ’ 
(U^(W  +  1) 


2  o 

<u  S, 


u)  <  .869 


.869  <  iii  <  1.084 


(4.0.29) 


cu  >  1.084 


(4.0.30) 


Putting  these  quantities  into  equation  (4.0.26)  shows  that  for  this  problem 


,  R.2  ,  R..2 

(«!)  -  (*2^ 


—  I 

TT  J 


.869 


U)  +  u>  +  1 


dm  + 


1  1 
'TT’-r.869  2 


1  “ 

—  I 

n  Ji. 


084  m®  +  u)^  +  3 


dm. 


(4.0.31) 


The  solution  of  this  integral  gives  ntuierlcal  values 
specifying  performance  of  the  estimator  the  tightest 
specified  is 


for  e^  and  e^.  When 
bound  which  may  be 


1*11  <  e" 


(4.0.32) 


$ 


(4.0.33) 
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rather  than  the  less  restrictive  bound  which  results  from  the  least  squares 
method 


2 

®1 


+ 


2 

“2 
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,  R.2 

<‘2>  ■ 


(4.0.34) 
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5 .  CONCLUSION 


5,1.  Summary 

The  purpose  of  this  paper  was  co  Investigate  methods  for  apply¬ 
ing  results  from  current  slngle-dlmenslonal  Wiener  filtering  theory  to 
multivariable  dynamical  systems.  To  accomplish  this  end,  consideration 
was  restricted  to  systems  with  one  observation  process  and  multiple  state 
processes,  with  the  observation  process  corrupted  by  an  additive  scalar 
random  process  of  uncertain  spectral  density,  and  the  vector  state  pro¬ 
cess  subject  to  a  similar  additive  scalar  noise. 

Under  this  restriction  to  multiple-state  systems  several  useful 
results  were  obtained.  Two  reasonable  game- theoretic  minlmax  formulations 
were  suggested  for  the  robust  estimator.  The  state-by -state  formulation 
minimizes  each  states  worst  case  error  over  the  allowable  filter  stiruc- 
tures,  while  the  least  squares  formulation  minimizes  the  sum  of  the  squared 
error  of  the  states  over  the  allowable  (vector)  filter  structures.  For  non- 
causal  problems,  methods  were  derived  for  solving  each  of  the  formulations 
In  terms  of  well-established  one-dlmenslonal  results  In  Sections  3.3  and 
3.4.  Section  3.3.2  established  that  when  each  state  problem  of  the  state- 
by-state  formulation  has  Identical  least- favorable  spectral  pair  solutions, 
the  state-by-state  and  least-squares  robust  solutions  are  identical.  Pro¬ 
blems  of  the  spectral-band  uncertainty  type  were  shown  to  have  this  pro¬ 
perty.  Additionally,  In  such  cases,  more  restrictive  bounds  may  be  placed 
on  the  error  using  the  state -by- state  approach,  even  If  the  least-squares 
method  seems  more  physically  relevant  to  the  design.  All  of  these  findings 
were  based  on  sliiq>le  transformations  and  known  one-dlmenslonal  results. 
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Section  3.5  discussed  briefly  the  failure  of  similar  methods  when  a 
causal  solution  Is  desired. 

Finally  a  design  example  was  solved  by  the  direct  least-squares 
method  of  Section  3.4,  and  an  error  bound  computed  using  the  results  of 
Section  3.3.2,  to  Illustrate  an  application  of  the  theoretical  results 
of  Chapter  3. 

5.2.  Topics  for  Further  Research 

Due  to  the  rather  restrictive  assumptions  made  in  the  bulk  of 
this  Investigation,  several  Issues  for  additional  study  are  apparent 
from  the  outset. 

Section  3.1  mentioned  briefly  the  desirability  of  techniques 
for  handling  truly  multivariable  systems  with  vector  observation  and 
noise  processes.  It  Is  anticipated  that  much  of  the  work  presented  here 
Is  closely  related  to  methods  which  could  be  productive  for  such  pro¬ 
blems. 

The  difficulties  encountered  In  Section  3.5  for  causal  robust 
problems  are  primarily  a  result  of  the  fact  that  the  set  of  causal  filter 
transfer  functions  Is  not  Invariant  under  the  necessary  transformation. 
These  problems  might  be  approached  as  outlined  if  more  general  one- 
dlmenslonal  conventional  Wiener  filtering  results  are  derived,  but  the 
author  suspects  that  an  entirely  different  approach  is  more  feasible. 

Perhaps  the  most  blatant  question  which  remains  unresolved 
concerns  the  class  of  problems  to  which  Theorem  3.1  may  be  applied. 
Specifically,  the  types  of  problems  for  which  each  states  least  favo¬ 
rable  spectral  pair  Is  Identical  was  shown  to  Include  spectral-band 


and  mixture  models.  The  same  may  be  true  in  general  for  all  spectral 
uncertainty  models,  or  at  least  for  a  large  variety  of  models.  Estab¬ 
lishment  of  such  a  fact  produces  inane diate  solutions  using  the  results 
of  this  paper  for  non-causal  multiple-state  problems,  so  studies  of 
this  type  might  prove  very  worthwhile. 
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APPENDIX 


\\ 


f. 


i 


I 


The  somewhat  lengthy  theorem  due  to  Kassam  and  Llm  Is  presented 
here  very  much  as  it  appears  in  their  article  [4] ,  except  for  revision  of 
notation  to  agree  with  that  of  this  paper. 

First  define  the  following  sub-sets  of  the  real  line,  which  will 
appear  in  the  statements  and  proofs  of  the  theorem  for  the  band-model 

oij_(k^)  -  <  kgN^(co)  <  Sy(u)},  (A.l) 

a-(k  )  ■  {ai|  S  (oj)  <  S  (oj)  <  k  N  (oj)  } ,  (A.  2) 

g-  (k  )  -  {a)|k  N.  (oj)  <  S-  (w)  <  k  N,.(a))  },  (A.  3) 

In  '  n  L  L  n  U 

and 

0,(k^)  -  {aj|k  N,  U)  <k  N„(a,)  <S-(a))},  (A. 4) 

2  n  '  n  L  n  U  L 

these  sets  being  dependent  on  the  values  of  the  finite,  positive  parameters 


k  and  k  .  Also  define  the  sets  Qi(k  ),  3(k  )  by 
s  n  '  s  ’  n 

o(k  )  -  a  (k  )Ua-(k  )  ■  {uj S  (u)  < k  N  (u) }  (A. 5) 

S  XS^S  JL  Su 

and 

6(k„)  -  6.(k„)U6,(k„)  -  {u|k  N,  (u>)  <  S- (uj)}.  (A.6) 

n  inzn  nL  L 

Also  define  the  following  four  sets : 

bj^(ig)  -  {a)|Sy(u))  >  JlgNy(w)  >  Sj^(u))},  (A. 7) 

b,(i_)  -  {a)|S„(u)  >  S.  (w)  >  i  N„(u)},  (A. 8) 

2  s  U  L  S  U 

-  {ojI  ijjNy(u))  >  Sy(u))  >  i^Nj^(u))},  (A. 9) 


E 


where  the  parameters  £  ,  £  are  finite  and  positive.  Again  define  the  sets 

s  n 

a(£  )  and  b(£  )  by  a(£  )  »  a,  (£  )Ua_(£  )  and  b(£  )»b.  (£  )ub»(£  ),  so  that 
s  n  siszs  nln^n 


b(£g)  =  {a)lSy(a>)  >  } 


(A. 11) 


a(£  )  "  {coil  N  ((»))>  S  (w)}, 
n  n  u  u 


(A. 12) 


The  structure  of  the  robust  solution  to  the  filtering  problem 
depends  on  the  nature  of,  and  existence  of,  the  solutions  of  the  following 


equations 


where 


Pn(x)l^  -2.P3 
n 


P  (x)  *  X  /  ,  vN.  (a))doj  +  /  f  ..S„(a))du  +  /-/  vS-(u))daj 

s  •'a^(x)  L  0  a(x)  L 


(A.13) 


(A.14) 


(A. 15) 


In  addition,  for  the  band-model  we  may  have  to  consider  solutions  for 


where 


q/x)!,  .2.P 

S 


V'>li  ■'’"’e 

n 


(A. 17) 


(A. 18) 


■  *  4j(x)V“>'^  *  ^b2(x) ^b(x)®o‘"*‘‘“ 

Ob'*’  ■  X  /a, (x)So'“)'‘“  ♦  /a,(x)\<“>’‘“-^ ^i(x)''o'“>'‘“- 


The  robust  solution  for  the  band-model  filtering  problem  can  now  be  stated 
explicitly: 


n 


61 


n 


Theorem  1  (Band-Model):  H  (tu)  (satisfying  equation  (2.2.14)) 

p 

The  most  robust  filter,  H  (  )  (satisfying  equation  (2.2.14))  for 
R  R 

the  pair  of  PSD's  S_(u)€2t.  and  S-((j)€^  defined  according  to  one  of  the 

<;  9 

following : 

(a)  If  exist  satisfying  (A. 13)  and  (A. 14)  then 


ii 


S^(oj)  =  ( 


,R. 

*9^ 


k^N^ (u) , 
s  L 

we  a,  (k^) 

1  S 

Sy(aj)  , 

we  ’ 

S^(u) , 

we  o(k  ) 
s 

ir  • 

n 

we  8,  (k  ) 

1  n 

Ny(u) , 

wS  8,(k  )  . 
z  n 

\(u) , 

we  B(k  ) 
n 

(A. 21) 


(A. 22) 


(b)  If  (A. 13)  and  (A. 14)  do  not  have  solutions  k  ,  k  satisfying 

s  n 

k  <  k  ,  and  if  the  following  are  valid  PSD's  for  the  band-model,  then 
s  cx 


le 


Sj(a)) 


kN,  (o))  +  S  (uj)  ,  u)ea-(k) 


V 

/ 


s^M 

S  (uj)  +  s  (oj)  , 

L  e 

Sj^(a))  , 


s*(«) 


(1)  e  (k) 


us  8j^(k) 
ue  82  (k) 


^  Sj^(a))+Ng(a>),  U6  8j^(k) 


Ny(u) , 

Nj^(u)  +  N^(u), 


u)€  aj^(k) 

u€  02^^) 


(A. 23) 


(A. 24) 


where  k  satisfies 


^’”'5  -  B,(W®L 

k  =  - - - - -  (A. 25) 

^"‘'e  - 

and  S  (co)  ,  N  (oj)  can  be  any  non-negative  functions  satisfying 
6  6 

S  (oj)  -  kN  (oj).  (A.  26) 

e  e 

(c)  If  neither  (a)  nor  (b)  above  yield  the  robust  solution,  then  If 
I  ,  I  are  solutions  of  (A. 17)  and  (A. 18)  (with  I  >  I  necessarily!  we  have 

i  N  (oj)  ,  oaeb,  (£  ) 
s  U  Is 

S-(u),  a.€b-(l  ),  (A. 27) 

L  z  s 

s  (u),  we  5(1  ) 

U  s 

■^Sy(u)),  a,€a^(l^) 

n 

N.  (u)),  aJ€a,(l  ).  (A. 28) 

u  z  n 

N  (w)  ,  (iie  5(li„) 
u  n 

p 

Finally,  If  (A. 17)  for  1  has  no  solution,  S^(u))  can  be  picked  to  be  S„(aj) 

s  5  U 

when  N„(a))  >  0  and  arbitrary  otherwise,  and  If  (A. 18)  for  1  has  no  solution, 
U  tl 

S  (co)  can  be  picked  to  be  N„(u))  when  S„(a))  >  0  and  arbitrary  otherwise 

“  u  u 

(satisfying  the  power  constraints) . 

Proof:  See  [4], 


